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ABSTRACT 

This study evaluated the effectiveness of Jigsaw as a 
strategy to prevent substance abuse* Jigsaw is a structered peer 
teaching program in which students teiach part of the regular 
classroom curriculum to a groi^bf peers* The goals of Jigsaw were to 
make student learning more active and student-student interactions 
more cooperative* As a result of these changes, students were 
expected to develop more positive attitudes, behaviors and norms 
regarding self, peers and school* Eventually, these gains should 
reduce .students • acceptance and use of psychoactive substances* The 
treatment v group consisted of 13 fourth-sixth grade teachers and their 
261 students* Thirty teachers and their 560 students served as the 
nonparticipant comparison group* the Jigsaw in-service training 
consisted of two-hour sessions, held once a week for nine weeks, and 
one review session held six weeks l&ter* The trainer assisted 
teachers in their classrooms both before and after the training 
ended* Participant and nonparticipant teachers .and students were pre- 
and post- tested and data regarding achievement and attendance were 
gathered from school district records* Teachers also rated their 
students 9 classroom behavior* (Author/CE) 
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Abstract 



This study evaluated the effectiveness of Jigsaw as a strategy to 
n,™nt Lbstance abuse. Jigsaw is a structured peer teachmg program in 
EmTJiSKS teach Ilk of the regular classroom curriculum to a group 

reduce students' acceptance and use of psychoactive substances. 

. The. treatment group consisted of 13 4th-6th grade teachers and their 
261 studente /Thirty teachers arid their 56 t p students served as the non- 
participant comparison group. 

tlie Jiosaw in-service training consisted of ^^^eks^Ute" 
once a for nine weeks, and one review sessi on .^ld six weeks 'ajer. 
The trainer assisted teachers in their classrooms both before and after the 
training ended. 

Process evaluation data included a) teacher feedback on the individual 
traininTsessions, b) questionnaire surveys of participating teachers, 
cTweekly repots by teachers on implementation, and d) classroom observation. 

aZ1T*f^i»1nin9 three classrooms students were largely off-task. 

• ParMcioant and nonparticipant teachers and students were pre-'and post- 

4 i£Ss-« 

KeeTparMclpant and nonparticipant students though they di d o ot 



results from the participant vs. nonparticipant analyses'. There were positive 
effects for 6th grade boys on cooperative classroom climate and major disci- 
pline problems? a positive effect for 5th grade girls on locus of control for 
failure, and a negative effect for 6th grade girls on affective teaching 
climate. The results were discussed in terms of problems with treatment 
implementation. 
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Introduction 



Jigsaw is a structured/ pe*er teaching program in which students teach 
part of the regular classroom curriculum to a group of peers (Aronson, 
Blaney, Stephan, Sikes & Snapp, 1978). Li Jigsaw, an academic lesson is 
divided into five or six parts and each student in a group of five or six 
is given' only one part of the lfiss.cn. Students must become experts on their 
particular part of the lesson and teach it to students in their groups so 
that all students learn the* entire lesson. Prior to teaching, students meet 
in Expert groups with their counterparts from other groups. In these groups 
students help each othe- prepare to teach their part to their respective 
Jigsaw groups. Like-putting together a jigsaw puzzle, each student contri- . 
butes a necessary and unique piece of information to group mastery of an 
assigned task. . 

• C The present study investigated the effectiveness of Jigsaw as a strategy 
to prevent substance abuse. The immediate goals-of Jigsaw were to make 
student learning more active and student-student interactions more cooperative. 
Reviews of research on cooperative learning (Johnson, 1980b; Sharan, 1980; 
flavin, 1980), indicate that these changes should foster positive attitudes, 
behaviors and norms regarding self, peers and school. Additionally, Jigsaw ^ 
has positively affected elementary students' self-esteem, attitudes toward 
peers, and attitude toward school (Blaney,* Stephen, Rosenfield, Aronson & 
Sikes, 1977). Eventually, the predicted positive changes in attitudes and nerms 
should reduce acceptance and use of psychoactive substances (Johnson, - 1980a) . • 



Jigsaw in-service training was provided to 13 4th-6th grade teachers 
in four elementary schools during the 1979-80 school year. The teachers , 
used Jigsaw in their classrooms under the guidance of an in-service trainer. 
The teachers delivered the intervention; thus, the adequacy of the^treatment 
depended upon teachers' use of Jigsaw. Consequently, 'teachers' reactions to 
the training were monitored as were react Ions to the conduct of Jigsaw .acti- 
vities in the classroom. . 

The impact of Jigsaw on both the teachefs°and their students was assessed. 
Three teacher outcome variables were measured:' teachers' perceptions of the 
importance of, and their effectiveness at, achieving the objectives of Jigsaw; 
satisfaction with teaching; and perceived faculty cohesiveness. We hypothe- 
sized that Jigsaw would impact all three of rthese outcome variables. 

Student outcome variables were perceived classroom climate, locus of 
control, social and academic self-esteem, attitudes toward peers, attitudes 
and perceived peer attitudes toward school, attendance, reading and mathe- 
matics achievement, and teacher ratings of student behavior. Drug-specific 
outcome variables Were perceived positive and^egative consequences of tobacco, 
alcohol, and marijuana use;"and involvement in use of each of these substances. 
Among these variables, we hypothesized that Jigsaw would impact all but the - 
drug-related variables. We did not expect effects on the drug-specific - 
variables due to the low level of drug involvement at these ages and the limited 

* ° 

duration of the intervention. The present study will be continued for an 
additional year. 



* Method 

Research Design % „ 

TheTubjects in this study participated in another stud* the prior yearr 
InFall 1978, eight elementary schools (grades K-6) from a predominantly 
white, middle-class, suburban public school system in Northern California 
were paired based on characteristics of their students, faculties, principals, 
and.speci.al programs. In addition, two district officiates ted each school^ 
regarding the degree tb which: a) eligible teachers would support and parti- 
cipate in the in-service training; b) eligible teachers were already competent 
in classroom management and interpersonal skills! c) the principal would 
support the in-service training; and d) the principal had influence over his 
orW teaching staff. -One school from each pai /was, randomly assigned to 
the experimental condition and the other to the control condition. Eighteen 
of the 23 teachers in gracJes 4.6 in the experimental schools completed in- 
service training in Effective Classroom Management .(see Schaps, Moskowitz, 
Condon and Malvin, Note 1, for the procedures and results of this study). 

The present study began in Spring 1979. Two of the original experimental 
schools and two of the original central schools were randomly assigned to the 
experimental condition, and the other four schools, to the control condition, 
^n Fall 1979, Jigsaw in-service training was offered to the 25 grade 4-6 
teachers in the experimental schools. Only 13 teachers completed the training. 1 

•. . . , » ' 

»TV» additional teachers enrolled in the training but dropped out after < 
several weeks. Tbey did not conduct classroom activities related to the training 
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^.Because half of the teachers in the experimental schools did not 
-complete Jigsaw training, about half df the experimental students did not 
participate in Jigsaw/ Comparing all experimental s with al-1 controls provides 
an insensitive test' of Jigsaw.'s effectiveness. Thus, we have opted to ignore 
th e expedmenta] design ancf to compare t eachers and students who participated 
in Jigsaw (participants) -with all remaining teachers and students (nonparti- 
c1 pants). 'The research design employs" a noneq'iivalent control group 
' (nonparticipants) with a pretest and a posttest (Cook and Campbell, 1979). . 

■ • • ' ' J- 

Subjects 

The subjects were students in grades 4-6 and their teachers during the 
1979-1980 school year. , At the beginning of the study, 295 students were 
enrolled in the 12 participant classes and 685 students were enrolled in the 
nonparticipant classes. However, 34 (12%) student participants and 125 (18%) 
student nonparticipants were excluded due to attrition or lack of parental 

permission for" testing. 

The participant group consisted of 36, 39, and 38 males, and 56, 42, and 
50 females in grades 4-6, respectively. The nonparticipant group consisted 
of 92, 102, and 85 males, and 107, 93, and 81 females in grades 4-6 respect- 
ively. The ethnic composition was 93% white with Mexican-American (3%\ 
comprising the largest mi nqri ty , grou> . 

Of the 13 participant teachers, four were male. Two of the participants 
taught half-time in the same class. 'Of the 30 nonparticipant teachers, 12 
were m&W^pur of the nonparticipants taught half-time. 
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In-Service Training Program ** 4 

< 

Two-hour in-service training sessions were held once a week for nine 
weeks. ..There was an additional two-hour review session six weeks after 
training ended. During and after the tfafmng, Jthe trainer assisted teachers 
in their classrooms. Teachers who attended the training sessions and tried to 
implement Jigsaw in their classrooms were paid a $200 stipend and were offered 
graduate-level credits through a local university. , 

In the* first 'training session, the trainer provided an overview of the ' 
Jigsaw program. Teachers participated in a team-building exercise designed 
to enhance cooperation, communication, and 1nd1y1dU?l responsibility in groups. 
They were also provided the materials for implementing this and another exercise 
in their classrooms. Beginning with the second session, the trainer facilitated 
weekly discussions of the teachers '. experiences introducing the Jigsaw a^tivi- 

r 

ties in their classrooms. % , ~ . ' % 

In the next several sessions teachers learned methods for training students 
to observe group behavior, to interact with each other productively, and to 

communicate and listen well. 

Sessions fiveand six focused on developing leadership and problem-solving 
skills of 'students. Teachers learned techniques for teaching different leader- 
ship styles to students. Teachers also learned specific techniques for 
effectively intervening .in group process to help solve group problems. 

in sessions seven through nine, teachers were shown how to develop Jigsaw 
curricula and were -given time to prepare curriculum units for use in their * 
classrooms.. Session seven also provided teachers -with a method for improving 
students' teaching skills. Sessions eight and nine included teacher practice 
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in making observations <# group process. (See Tuck and Schaps, Note 2, for 
'training curriculum).' . 



Measures 



Student self-report data . Student data a-t pretest were obtained .with 
an instrument developed for this slSy called the Student Questionnaire. 
This instrument consists of two parts. Part 1 contains 18 item* selected 
from the Intellectual Ach cement Responsibility Questionnaire (Craodell, 
Katkovsky, ft Crandall, 196b), 2 Selection pf items was basetf upon published 
'psychometric properties. This questionnaire measures the belief in one's 
own control over intellectual and academic performance. Part 2 contain^three 
sf*s of items: a)' the Scholastic subscale from the Intermediate Level of the , 
Self Appraisal-Inventory (20 items) (Instructional Objectives Exchange. Note 3), 
a- criterion-referenced measure of academic self-esteem; b) the Authority and 
Control (12 items) and. Interpersonal Relationships With Pupils (-12 Hems) 
subscales from the Intermediate-Level of the School Sentiment Index (Instruc- 
tional Objectives' Exchange, Note 4),.a criterion-referenced measure of . 
attitudes toward school developed for this study by adapting 11 items from 
-•eight instruments that measure attitudes toward school. . 

.- Student pretest'data were also obtained with the Self Observation Scales . 
(Intermedial^ Level, Form C) developed by Stenner and Katzenmeyer (Note 5). 
This instrument measures' how children perceive their social and academic. selves 

— — ca 

California Education Code requires that active parental permission be 
secured before requesting .information about family life. Because this study 
employed passive consent procedures , four items referring to 'parents were 
adapted to read "an adult who knows you." - 
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and their relationship to 'peers, teachers, and school. Students respond "yes" 
or "no' r to 60 statements.' * 

• - " Drug-related pretext data were collected using the My Opinion Survey. . 
This instr'r^ent was developed for this- study, to assess student opinions of 
each of the three "gatewly" drygs-al«jhol., cigarettes, and marijuana. Speci- 
fically, students indicated the consequences of using the drug and reported 
their lifetime use, their current use ("last four weeks"), their attitudes, 
toward use, their perceptions, of peers' attitudes totfard use ("most kids in 
my class"), and their penceptions of peer use,. 

• « 

* * The pretest measures used in the data analysis were derived from empirical 
scaling. 3 Pretest data. were collected from, a large sample of students in 
grades 3-6. Item means, variances, and intercorrelations^ere found to be 
similar across grade levels; thus, students from all three grades were grouped 
together for the scaling. Item intercor'relations from the^ pretest data were 
subjected O to separate multiple group confirmatory factor analyses," The 
resultant^ pretest scales appear in Table 2 with the number of items and the- 
internal consistency reliability estimated by coefficient alpha. The final 
scales measured affective teaching climate, attitudes toward school, social 
self-esteem,, attitudes toward peers, locus of control for success, locus of 
control for failure, academic self-esteemt perceived peer attitudes toward 
school,. perceived costs of and involvement in alcohol , cigarette, and marijuana 

,. 1 • • 

' * *The details. of the scaling have been reported by Moskowitz, Condon, 
Brewer, Schaps & Malvin, Note 6. « 1 . 

''The correlation matrices were' computed using pairwise'deleticwi of missing 
values and communal i ties were -inserted into their diagonal elements. 



Table 2 

STUDENT SCALES. NUMBER OF ITEMS AND PRETEST 
INTERNTcONsfsTENCY RELIABILITIES (COEFFICIENT ALPHA) 



c i ' N Items .- Reliability. 

Affective Teaching Climate >91 
(Affec Climate) * - 513 , 

Attitudes Toward School 6 • .74 

, (Att School) r 513 e 

Social Self-Esteem . - ! ' .66 

(Social Self) % 513 0 

Attitudes Tqward"-Peers^ g >80 

(Att Peers) t 513 ° 

Locus of Control: Success j 56 

(Control Sue) 513 . ' 

Locus of Control:- Failure . .62 

,v (Control Fail) 513 * ' 

Academic Self-Esteem >7S 
(Acad Self) 513 . 1 1 

* * 

Perceived Peer Attitudes 
' Toward Seteol 
. (Peer Att Sch) 

Perceived Costs of Alcohol Use 70 
^(Alc Costs) .386 & 

Perceived Costs of Cigarette Use 63 
' (Cig Costs) 386 . 

Perceived C^sts of Marijuana Use . • . 67 

(POt Costs) • 386 » 

Involvement in Alcohol Use , 77 

/m- Y„.,«1u^ Job 3 • 



-Toward Sehool 8 .72 



(Ale Tnvolve j 

Involvement in Cigarette Use 75 
(Cig Involve) • 

Involvement in Marijuana Use / 84 
. (Pot Involve) . . / ^ 386 



use. . The Involvement scales were comprised of items measuring own use and 

attitudes, and perceived use and attitudes. 5 < t 

Posttest data were obtained with revised versions of the Student Ques- 
tionnaire and the My Opinion Survey. The revised instruments included the 
items in the" final pretest measures. The Tocus'of control for success scale 
contained five additional items and the failure scale contained three addi-. 
tional items. Measures'of cooperative (Coop) and competitive (Comp) classroom 
climate were fncluded in the posttest. These measures, which^were developed 
for this study, assess the students' perceptions of the prevalence of 
cooperation and competition in their classrooms. The alpha coefficients 
were .73 and :77, respectively.. 

student archival data . In addition to the student self-report data, we 
useo achievement data collected by the, school district .-"These data included t 
the tota.1 reading* (Read) and total mathematics (Math) stanine scores from 
the Stanford Achievement Test, Primary Level III (grade 3) and Intermediate 
Levels I (grade 4) and II (grades 5 and 6) (Madden, Gardner, Rudman, Karlsen, 
Merwin, 1973), administered in May 1979, and in May 1980. 

Studenfattendafice was measured in two ways. The total number of unex- 
cused absences for the second semester (Unex Abs) was obtained for each student 
■ from the school district's records. This type of absence occurred when a stu- 
dent was absent from school and did not provide the school with a parental 
excuse stating that the student was sick. In addition, the average monthly 



5 For each substance, the five component items exhibited good eternal and 
external consistency, providing support for /a single scale. The Positive 
rel aiionships betweeen the perceived peer measures and the own use and attitude 
measures indicate that students' own use and attitudes parallel their peers , 
or that they 'project their.own use and attitudes onto their peers. 
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number^ absences for each 1 student (Total Abs) during the fifth through 
eighth school months (January through April) was extracted from teachers' , 
records by project Staff. * Both measures were obtained for Spring 1979 and 
'Spring 1980. 

Students' sex aifa ethnicity were determined from school district records. 
Teacher data, on student behavior . Teacher ratings t of student misbehavior 
were, obtained at pretest and posttest with the Student Behavior .Report. 6 
Using the class roster, each teacher indicated how frequently each child had 
been a minor (Minor) and major (Major) discipline problem during the previous 
four months .(January .through April). A five-point scale was used that ranged 
from "never" to "about once a day or more*" 

To determine whether experimental and. control teachers used the "minor" 
and "jnajor" categories in the same manner, teachers rated 17 hypothetical 
student behaviors as either a) not a discipline- problem, b) a minor problem, 
or c) a major . problem.- The pretest data were invalid because most teachers 
did not follow the instructions; hence, instructions for the posttest were 
revised. Analysis of the posttest data indicated that experimental and control 
teachers employed similar definitions of minor and major discipline problems. 

Tearher outcome .data . The teacher's pretest and posttest self-report 
data were obtained with the Teacher Questionnaire that was developed for this 
study. This instrument measured a,) satisfaction with teaching, adapted fronr 
the Purduejeacher Morale Inventory (Rempel and Bentley, 1964); b) faculty 
cohesi veness, adapted from the Teacher Cooperation Subscale of the Teacher 

> 6 The teachers who provided "the pretest data were the students' teachers 
in the prior year. v 
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Attitude and Classroom Climate Questionnaire (Kaufman, Semtiel & Agard, Note 7) 

c 

and from the Intimacy Sjbscale of the Organization Climate Description 
Questionnaire (Halpin and Croft, 1963); and c) the importance and. effective- 
ness or achieving teaching objectives related to Jigsaw, a measure developed 
for this study. Table 3 shows the number of items included in these scales 
and the pretest internal consistency reliabilities estimated by Coefficient 
Alpha for grade 3-6 teachers. 7 



Data Collection Procedures 



Student survey . Students in grade 4 were given'the pretest in October 
1979 and the posttest in May 1980. The revised Student Questionnaire was - 
administered at both times/ My Opinion Survey was read to the students during 
a separate session at the pretest. 

Students in grades 5 and 6 were given the pretest in^May 1979 and the post- 
test in May 1980. The Student Questionnaire and My Opinion Survey were 
administered at both times during two sessions in the students' classrooms. 
The Self Observation Scales were administered at the pretest during the first 
session. The students read the items to themselves assisted as necessary by 
the survey administrator. One make up session was held for all students who 
were absent from the original sessions. 

Survev administrators were substitute teachers in the district who were 
trained by project staff. . In a prepared statement, survey administrators 
assured students of complete confidentiality. The confidentiality of the My 
Opinion Survey administration was, enhanced by prelabeling questionnaires with 



7 To increase the sample size, additional teachers were included in the 
scaling analysis. 
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Table 3 

TEACHER SCALES, NUMBER OF ITEMS, AND PRETEST . 
INTERNAL CONSISTENCY RELIABILITIES (COEFFICIENT ALPHA) (N=60) 



Number of Pre J"* 
Items Reliability 



Jigsaw Objectives 



Teacher Satisfaction 8 



Faculty Cohesiveness 



'ERIC ' 16 



.74 



.80 



.90 



Ik 



15. ' 



student names on the cover sheet and students" school -district identification 
numbers on page one. After receiving the questionnaire, students were instruc- 
ted to tear off the cover page which displayed their names. Students were told 
of the need for identification numbers as a way of tracking students over time. 

Teacher survey . Teachers completed the pretest Teacher Questionnaire in 
September 1978. Teachers completed the posttest questionnaires in their . 
classrooms while their students' completed the posttest. To ensure the privacy 
of their responses, teachers were' provided with questionnaires containing 
unique Identifiers. 

Data Analysis 

The research design employed 'a nonequivalent control group. With this , t 
design, differences obtained'between the participant and nonpar* cl pant groups • 
could be unrelated to the treatment. Participating teachers (and their students) 
were likely to differ from nonpar tici pants simply because they constituted a 
special group-teachers who chose to undertake and complete the training. The 
pretest data were subiected to analysis of variance to explore initial non- 
equivalence. The posttest data were subjected to analysis, of covariance using 
the corresponding pretest as a covariate. This common technique approximately 
controls for pre-existing differences. Ideally, each posttesj. measure should 
be adjusted for all related pre-existing differences and the pretest measures' 
should be free of measurement error (Reichardt, 1979)*. 

A class-level analysis usually is appropriate with this design. Unfortu- 
nately, differences between grade levels were found on many cf the variables, 
and there were few classes in each grade. Therefore, when^grade level was - 



17 



employed as a factor in the design, cell sizes were very small. Thus, 
statistical analysis performed at the class level had low. power. Analysis 
of student-level data was likely to produce spurious results due to the 

interdependence of individual students within each class and due to excessive 

c 

statistical power. We chose to analyze the data at the student level aware 
that the analysis may provide biased estimates of treatment effects. 

In the present study, we set the Type I error rate for each analysis 0 ^ 
.05. This is a liberal level given the unit of analysis problem, and the fact 
that separate analyses were performed for each grade-sex student group due to 
the existence of heterogeneity of variance and pre-post covariancein mar\y of 
the measures. Since many analyses were conducted, isolated effects must be 
interpreted cautiously because they may be due to experiment-wise Type I error. 
Interpretatiqn of results is based on .patterns of findings rather than single 
findings. 

Rules were set for handling missing data in computing scale scores. A 
scale score was computed for a student if at least 60% of the items comprising 
that scale were present. Any missing item score was replaced by the mean for. 
that item in the appropriate cell of the experimental design: This procedure 

0 

utilized most of the item data and provided unbiased cell means. When more 
than 40% of the items comprising a scale were missing, the student received * 
a missing value for that scale, and the case was dropped from anyanalysis 
involving that scale*. . 
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Process Evaluation 

0 

I 

«* 

iS 

v '* A 

Teacher Feedback on the Individual Training Sessions 

At the end of each training session (except the final session), teachers 
were asked to complete a one-page "feedback form" anonymously.- Teachers 
rated each session in terms of organization, interest, usefulness, and en joy- 
ableness on five-point scales (where five was positive). Open endri comments 

were also encouraged. 

All sessions were rated positively. Of the 32 serrate ratings (four per 
session), 26 averaged above 4.50 and only one average rVtiig was less than 4.0. 
Thus, the teachers regarded the training highly. 

Questionnair e Snrvpys of Participating Teachers 

At the completion of training (January 1980), and again : near the end of 
the school year (May 1980), participating teachers completed questionnaires 
that elicited detailed information about implementation of the in-service 
skills. Teachers reported how often they used each in-service skill, rated thd 
usefulness of each skill, and rated their mastery of each skill. 

Table 4 shows the year-end data on frequency of implementation, usefulness 
and mastery of the skills. More than half the teachers were using most'skills 
at least several Jimes per v/eek, and two skills every day: Three skills were 
used by the teachers on less than a weekly basis: conducting group process 
discussions, coordinating Jigsaw resources, and developing Jigsaw curricula. 
This implementation pattern indicates that at least half of the participants 
continued to use the .skills for several months after they had completed training 
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Table ,4 

TEACHERS' REPORTS ON FREQUENCY, UTILITY, AND QUALITY OF SKILL IMPLEMENTATION (N = 11) 



In-Service^kill" 

'Observing groub process - 
(communication patterns, decision 
making procedures\on task/off task 
behavior, emqtionaKissues) 

Giving feedback using the rules for 
observer feedback 

Using attending skills (physically 
~ attending, observing, listening) 

Respond i ng to f eel i ng 

it 

Responding to meaning 

Modeling facilitator skills 

Intervening to solve group problems 
using appropriate technique (content 

. intervention, interpersonal inter- 
vention, intrapersonal intervention, 

* group intervention) 

Conducting group process discussion 
Coordinating Jigsaw, resources 
. Developing Jigsaw curricula 

ERJC' •' 



Percentage of. Teachers 
Using Skill at Least: 



Mean" Ratings, of Value 
of Skill (5=High 
Utility; l=Low Utility) 



Every 
Day 

15 



15 
54 



Several 
Times/Week 

6g 



6g 
92 



V 




4.83 

4.83 

4.92 

4.75 
3.67 
4.08 
4.36 



4.23 
3.92 
4.00 



Mean Ratings of Mastery 
of Skills (4=Excel lent; 
l=Poor) 



2.92 

r 

2.75 

3.08 

3.00 
2.83 
2.58 
2.60 



3.00 
3. $0 
2.92 



Teachers rated all of the skills as extremely useful. The teachers' 
average ratings of their mastery of the skills clustered between "fair" 
and "good."" Usefulness and mastery ratings, at mid-year were similar to 

-those-at-ye^r--«nd^ 

. The mid-year questionnaire asked the teachers to evaluate the in-service 
course as a whole, using five-point rating scales. These ratings were very 
favorable with respect to interest (M = 4.54} , organization (M = 4.82), 
usefulness (M = 4.27) and enjoyableness (M = 4.54). The trainer was also • 
rated highly along a number of dimensions. 

In sum, results from two questionnaire surveys indicate th^t many teachers 
used most of the skills on a regular basis, found the skills useful, considered 
themselves adept at using the skills, and evaluatsd-the training and the 
trainer positively. 

Frequency of Classroom Implementation 

Beginning with the onset of training, and continuing through the school 
year, participating teachers completed weekly logs indicating the number of 
classroom hours spent on Jigsaw activities. Data from 12 teachers 8 over 24 
weeks indicated wide variation in the implementation of Jigsaw activities; the 
average number of hours per week each teacher allotted to Jigsaw activities 
was 1.83 and ranged from .24 to 3.77. Four classrooms were involved in Jigsaw 
for more than two hours each week, six classrooms were involved in Jigsaw 



"Data from one teacher were deleted from this analysis because they were 
obviously falsified. 



22 



20. 



_ fo7Tto"lT7" hours each week, and one classroom was marginally involved in 
-Jigsaw (.24 hours per week). 9 

Classroom Observation 
___^sficyat1ons of Jigiaw activities were conducted three times during the 
school year; the first observation occurred between thefsixth -amMast-^eeki — 1 
of training, the second visit occurred four to six weeks after training 
ended, and the final visit occurred eight to 16 weeks after training ended. 10 
A random sample of six teachers was observed on the first two visits. On the 
last visit, all teachers who completed the' training, with one exception, were 
observed, and each visit was scheduled to coincide with the time peer- teachi ng ' 

(Jigsaw groups) would occur. 11 , G 
The observations were conducted by a trained observer. Two instruments 
were developed to characterize the ajigsaw classroom," the Jigsaw Checklist 
and the Jigsaw Observation Record. The' Jigsaw Checklist consisted of 13 
statements that described the student groups and student interaction. These 
statements generally were low inference and descriptive rather than evaluative. 
All statements that were applicable were checked after an observation was 



9 the total number of classrooms counted is one less than the number of 
teachers because two teachers are part-time in the same classroom. Data from 
these two teachers were added together and counted as one classroom. 

A 10 The posttest was administered during the 12th and 13th week after training 
ended, thus, several classrooms were observed after the posttest. 

1J 0ne teacher. who participated in training was not observed because she 
refused to schedule an appointment with the observer. 
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completed. * Characterizing the groups as Jigsaw groups required that a minimum 
of five specific statements be chfecked; also, a specific set of five Were 
used to characterize the groups as Expert groups. 

The teacheru were expected to be regularly using Jigsaw in their class- 
rooms by the first observation. The data revealed that in only one classroom 
was Jigsaw-implementect as expected. In three of the classrooms, students were 
engaged in pre-Jigsaw activities or "teambuilding." In the other two class- , 
rooms, students were involved in group work that the teachers described as 
either Jigsaw or Expert, but that -did not meet our criteria. 

* At the second observation, three classrooms were engaged in JigsSw or 
Expert group work. In three other classrooms, although the teachers told the 
observer ^that their students were in Jigsaw groups, the observer found no 
evidence for this. These teachers had created their own versions of Jigsaw. 
The critical difference in their versions of Jigsaw was that the students were 
working independently rather than cooperatively on an assignment*, although; 
they were seated in groups. 

Because Jigsaw is designed to be a peer-teaching technique, we examined 
the extent to which the teaching component was implemented. For the third 
series of observations, all teachers were observed during the time their 
students Were in Jigsaw groups. Of the 12 classrooms observed, five demon- 
strated the expected Jigsaw activities prior to the posttest. Two' additional 
classrooms implemented the peer- teaching aspect ^of Jigsaw before the end of 
the year, but after the posttest data were collected. p These classes were 
involved in Expert groups before the posttest. The remaining five classrooms 
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were- Involved in' various modifications of Jigsaw. Jhese modi ftcirtidn£ had 
at least, one feature in common; students wefe not teaching each other in •• 
small groups but were working independently on a given assignment. 

fn two of the f-ive'true Jigsaw jlassrooms obsepree^ore the posttest,- 
and in one true Jigsaw classroom observed afterwards, student groups were 
off-task for a substantial amount of time. A.serious task orientation is . 
necessary for adequate 'jigsaw imirtementationj. therefore, these classrooms did 
not fully meet our expectations. Three true^Jigsaw classrooms observed- before 
the posttest, and one observed afterwards, 'were exemplary in terms of Imple- 
mentation. -These classrooms not only met the minimum Jigsaw criteria but were 
notable for the focussed attention of the students on the tasks at hand. 

The Jigsaw Observation Record was designed to provide more specific detail 
regarding student behavior 'during group work. This instrument employed time 
samples primarily of student behavior. Each group «fs observed for 3(5 seconds, 
and all the codeable' behaviors that occurred during that interval were recorded 
A behavior was recorded only once, even though it may have occurred several ^ 
..times during the observation period. Each group W observed approximately " ' . 
five times during one visit. Since all the participants, were observed during 
the third round of observations, only the coded behavior from this "series of. 

visits is reported below. ' • 

The amount and type of student participation in the groups was approximate 
the same for all classrooms. A student leader could.clearly be distinguished 
in all the classrooms across most of the intervals of observation. There was" 
very little- helping behavior overall, with the exception of one ciassroom. 
Silent group work was observed frequently, The behavior "shares ideas' was 
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coded wheneveFa" Ttudent^WedTnTbrmaTion with the~group and; thus , 
included all peer-teaching -behaviors. The frequency with which this^behavior 
occurred discriminated two'groups of classrooms. In one group of classrooms, • 
this behavior occurred frequently. In these classrooms, Jigsaw was accurately 
implemented as indicated by the Checklist. In the ot»er classrooms, relatively 
little'student' teaching Was observed, and modified versions of Jigsaw were - 
used in them. 

- Off-task and disruptive behaviors were observed in .both Jigsaw and modi- 
fied Jigsaw classrooms. However, there was virtually no off-task behavior in 
five classrooms, four of which were Jigsaw* classrooms* Finally, "teacher 
helps" was -coded whenever the teacher became involved witha group upon request 
of a group member. This occurred almost exclusively in classrooms employing 
modifications of Jigsaw. Students were more inclined to seek cut the teachers' 
help in variations of Jigsaw than.' they were in true Jigsaw. 
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Results 

Initial Equivalence— Teachers , 

Teacher self-repdrt data collected prior to the training were analyzed 
to detem^ne whether participants and nonparticilpants were inkially equivalent. 
' The results indicated^hat the groups did Got differ in terms of teaching 
"experience,, use of various academic and affective techniques in the classroom, 
Teacher Satisfaction or Faculty Cohesiveness. However, compared to non- 
participants, participants scored higher on Jigsaw Objectives, F (1,33) » 4.80, 
p <0S. These results should be- interpreted cautiously because pretest data 

JE-^ i * O y m 

"were missing .from 42% of the teachers,. % 

\ The groups differed on prior in-service training. Sixty-two percent of 
Ihe participants completed ECM in-service training in the prior year as 
compared to only 23% of the nonpartici pants. 

Analysis of Teacher Outcomes 

The three teacher posttest measures were subjected to one-way {participant 
vs. nonparticipant) analyses of Variance. . No significant differences were 

obtained."":"' 

Descriptive Statistics for Student Measures ^ 

The means and standard deviations for all student pretest and posttest 
measures are summarized in Tables 5-7 by grade, sex, and treatment condition. 
Due to extreme non-normality and s heterogeneity of variance, log (x+1) trans- 
"formations were performed on the following variables: Attend, Unex Abs, 



' Measure 
Coop 
;Ccmp 

LAffec Climate 
Att School 
Social Self 
Att Peers 
Control Sue 

4 

Control Fail 
Acad Self • 
Peer Att Sch 
s. Total Abs 
Unex Abs 
Read 
Math 
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Table 5 
■ ■ « 
Means- and Standard Deviations for Student Data 
by Sex by Treatment Condition for Grade 4 



Male Students 



Female Students 



Test 



Pre 
Post 



Participant 
M SD 



Nonpar tici pa ret 
M SD / 



Participant Nonparticipant 
SD 



Post 


1.71 


.26 


1.67 


.26 


Post 


1.56 ' 


.29 


1.50 


.31 


Pre 
Post 


1.85 
1.80 


.18 
.20 


1 .86 
1.79 . 


on 
.28. 


Pre 
Post 


"-1.8T 
1.69 


.28 
.31 


1.80 
1.66 ~ 


.22 
.29 


Pre 
Post 


1.81 
1.83 


.28 

r 22 


1 .80 
1.79 


OO 

.21 


Pre 
Post 


1.68 ' 
1.75 


.25 
.31 


1 .73 
1.71 


.28 


Pre 
Post 


1.80 
T.76 


.15 
.17 


1 Q1 

1 .ol 
1.77 


• to 
.19 


Pre 
Post 


T.55 
1.65 


.25 
.25 


1.61 
1.66 


.24 
.22 


Pre 
Post 


1.72 
- «1 .72 


.23 
.23 


1.74 • 
1.72 


.21 
.23 


.Pre 
Post ' 


1.74 
1.70 


.20 
.23 


1.75 • 

• 


.23 
.25 


Pre 
Post 


.27 


.19 


•.23 * 


.19 


Pre . 
Post J 


.13 


.24 


.18 


.27 


Pre 
Post 


6.29 


1.68 


5.89 


1.76 



5.88 1.72 5.98 1.67 



M 

1.83 

1.52 

T.93 
1.90 

l.*9 
1.80 

1.79 
1.80 

1.69 
1.69 

1.84 
1.86 

1.64 
1.67 

1.76 
1.77 

.82 
• 1 .75 



.33 
J5 



.21 

.31 

M 
.14 

.24 
.21 

.24 
.26 

.25 
,.28 

.11 
.14 

.22 
.23 

.20 
.22 

.16 

'.18 



.24 
.20 



M 

1.74 

1.47 

1.87 
1.81 

1.78 
1.71 

1.78 
1.77 

1.71 
1.70 

1.84 
1.83 

1.64 
1.67 

1.75 
1.73 

.81 
T.70 



,.27 
.15 



SD 

.28 

.28 

.20-3 
.27 

.23 
.29 

.23 
..24. 

.27 
.30 

.14 

.16 : 

.24 
.24 

.21 
.24 

.21 
.27 

.20 
.24 



5.91 1.48 6.27^ 1 .30 
5;44 1.30 5.97 1.38 



S&Wv^^ ~. 
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Table 5 

Measure 
Minor 

Major ^ 
Ale Costs 
Cfg Costs 
Pot Costs 
Ale Involve 
Cig Involve 
Pot Involve 



Male Students 



Female Students 



Test 

Pre 
Post 

Pre 
Post 

Pre 
Post' 

Pre 
Post 

Pre" 
Post 

Pre 
Post 

Pre/ 
Post 

Pre 
Post 



Participant Nonpartfcipant . .Participant Nonpar tici pant, 
~m — §D~ M SD M SO p M SD 

2*47 1~56 1~97 1~33 1.64 1.09 1.22 .63 



.33 .68 .33 - .10 



.56 .48 .54 .50 



.48 .47 .48 



.45 



.46 .37 .42 .46 



.31 .03 .31 .05 



.45 .40 .59 .49. 



.38 .36 .47 .41 



.39 .36 .39 .39 



1.54 . 69 1.37 .63 1.30 .61 1.40 .58 



.27 .07 . 27 .08 



.25 .06 .24 .07 



.26 .06 .26 .07 



.24 . 06 . .25 .08 



0 



Table 6 



27. ' 



Means and Standard Deviations for Student Data 
by Sex by Treatment Condition for Grade 5 



Male Students 



Female Students 



Measure 
Coop > 
Ccmp, 

Affec CI imate 
Att School 
Social Self 
Att Peers 
Control Sue 
Control Fail 
Acad Self 
Peer Att Sen 
Total Abs 
Unex Abs 
. Read 
Math 



Test 


Participant, Nbnparticipant 
c M SD M SD 


Post 


1.69 


- .30 


1.71 


.26 


Post 


1.50 


.32 


1.48 


.31 


Pre 
Post 


1.81 
1.85 

* 


.09 

.21 


1 ./U 

i;8o 


91 
• C\ 

.26 


Pre 
Post 


1.73* 
1.72 


.27 
.29 


1.64 
1.62 


• .3Z * 


Pre 
Post 


1.78 
1.85 


ft 

.23 
' .23 


1.78 
1.84 


.26 
^ .21 


Pre 
Post 


1.73 
1.83 


.29 
.25 


1.71 
1.74 


.30 
.28 


Pre 
Post 


1.85 
.83 


.19 
.19 


1.80 
1,81 


.21 
.19 


Pre 
Post 


1.70 
1.71 


.20 
.22 


1.67 
1.71 


.27 
.23 


Pre 
Post 


1.77 
1.75 


.20 
.25 


1J4 
1.76 


.26 
.21 


Pre * 
Post 


1.79 
1.76 


i 

.21 
.20 


1.70 
1.70 


' .28 
.24 


Pre 
Post 


.21 
.20 

0 


' .17 
.18 


.25 


.16 
.16 


Pre 
Post 


.17 
.15 


.30 
.22 


.24 
.14 


.28 
.25 


Pre 
Post 


5.44 
5.85 


1.60 
1.60 


5.83 
6.21 


1.53 
1.45 


Pre 
Post « 


5.69 
6.10 


1.59 
1.57 


5.88 <■ 
5.98 


1.63 
1.59 



Participant Nonparticipant 



M 

1.69 

1.36 

1.82 
.1.84 

1.76 
1.72 

1.75 
1.85 

1.77 
1.70 

1.89 
1.85 

1.71 
1.78 

1.81 
1.74 

l;7S 
1:77 

.25 
.29 

.15 
.12 

5.71 
6.12 

5.31 
5.87 



SD 

.30 

.25 

.08 
.26 

.28 
.25 

.24 
.19 

.23 
.29 

.13 
.11 

.22 
.19 

.16 
.22 

.20 
.24 

.20 
.21 

, .26 
.23 

1.45 
1.29 

1.44 
1.38 



M 

1.78 

1.42 

1.75 
1.90^ 

1.74 
1.73 

1.79 
1.85 

1.72 
1.69 

.88 
1.83 

1.72 
1.65 

1.76 
1.76 

1.78 
1.74 

.22 
.28 

.27 
.19' 

6.24 
6.29 

6.00 
5.83 



SO 
.26 '% 
•28 
.18 

.16: 

.27 
.24- 

.25 

.'.23 

.28 
.29 

.15 

.is :\ 

.25 
.26 

.25 
.25 

.21 

, .26 

.19 
.19 

.30 

1.43^ 
1.43* 

1.55 
1.31 
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Table 6 









Male Students 




Measure 


Test 


. Participant 
-M SD 


Nonparticioant 
M SD 


Minor 

c 


Pre' 
Post 


1.82 ' 
2.12 


.79. 
1.24 


1.97 
2.09 


1.12 
1.30 


Major 


Pre 

/ Post 


.37 
.32 


.14 
.06 


'.36 


• .12 
.12 


Ale Costs 


Pre 
Post 


53 

.45 , 


.74 
.54 


.49 
.57 


.50 
.56 


Cig Costs 


o pre 
Post 


.32 
.35 


.32 
.47 


.35 
.45 


.35 
.47 


Pot CoSjts 


Pre 
Post 


29 
.25 


.30 
.36 


.34 
.42 


.40 
.50 


Ale Involve 


Pre 
" Post 


1.40 
1.50 


.00 

775 


1 Afl 
\ .40 

1.64 


• 0*» 

.78 


Cig Involve 


Pre 

One + 

rOSt 


.25 
.26 


.05 
.07 


.25 
.30 


.06 
.10 


Pot Involve 


• 

Pre 
Post 


.22 
.22 


.04 
.03 


.23 
.26 


.06 
.10 



28.' 

Fpmale Students 



u 


cn 


M 


SD 


2.08 


1.27 


1.27 


.63 


i An 




1 41 


80 


. .33 


.. .08 


.32 


.09 


.30 


.03 


• 6c 




.49 


.37 


< .46 


:" .43 


.48 


.43 


Af\ 

.40 


AC 

* , . 


.46 


.43 


.41 


.36 


Af\ 

.40 


AA 

c .44 


AT 


AV 


.41 


.37 


.36 


.35 


.JO 


AO 




37 


1.20 


.44 


1.18 


.50- 


, 1.43 


.56 


1 .38 


^o 

.59 


.25 


.07 


.24 


.06 


.27 


„.08 


.30 


.86 


.22 


.04 


.23 


.05 


.24 


.07 


.25 


.07 



4 ^ 
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Table 7 

Means and Standard Deviations for Student Dat/ 
by Sex by Treatment Condition for Grade 6 



« - 



Male Students 



Fpmale Students 



Measure 

Coop 
Ccrap 

Af fee Climate 

School 
Social Self 
Att Peers 
Control Sue 

J 

Control Fair 
Acad Self 
* Peer Att Sen 

Total Abs 
\ Onex Abs 
Read 
Math 



Parti cipant Hnnparticipant 



.29 

.29 

.19 
.28 

.30 
.30 

.19 
.17 

.27 
.27 

.18 
.18 

.24 

.22 

.22 
.23 

.24 
.27 

.18 
.17 

, .30 
.26 

1.57 
1.64 

1.64 
1.69 



pant 



Test 


M 


SD 


M 


Post 


1.83 


.21 


1.65 




1.38 


.29 


.1.41 


Pre 

Pnct 


1.74 
1.74 


:19 
.31 


1.71 
1.79 


Pre 

rOSZ 


1.71 
1 59 


.29 
.27 


1.59 
1.59 


Pre 

Dnct 

rOSt 


1.88 
1.86 


.16 
.19 


1.85 
1.87 


Pre 

rOSu 


1.74 
1.77 


.27 
.29 


1.75 
1.78 


Pre 


1.86 
1.83- 


.19 
.16 


1.82 
1.82 


Pre 

Dnct 


1.69 
1.75 


.26 
.21 


1.70 
1.73 


Pre 
Post 


1.79 
1 ./o 


.20 
20 


1.74 
1.74 


Pre 
Post 


1.77 
1.68 


.24 
.24 


1.68 
1.63 


Pre 
Post 


.21 
.21 


.20 
• 16 


.23 
.25 


Pre 
Post 


.27 
.18 


.31 
.27 


.23 
.14 


Pre 
Post 


5.91 
5.76 


1.40 
1.51 


5.96 
6.01 


Pre 
Post 


5.63 
5.79 


.1.41 
1.61 


5.83 
5.75 



M 


SD 


M 


SD 


1 OA 
1 .OH 




1 75 


.26 ; 


1.40 


.31 


1.41 


. 28 Z 


1,80 
1.69 


.11 
.34 


1.78 
1.87 


.13*! 


1.75 
1.64 


.27 
.26 


1.74 
1.68 


.27 - 
.28.- 


1.80 
1.81 


.27 
.23 


1.83 
1.86 


.22 
.20 . 


1.72 
1.71 


.30 

, .33 


1.72 
1.76 


.28 ■:• 

.26 


1.81 
1.83 


.22 
.17 


1.87 
1.88 


.17 i 


1.76 
1.76 


.25 
.23 


1.81 
1.82 


.23 ii 
.18 


1.68 
1.63 


.30 
.30 


1.77 
1.76 


.22 
.22 


T780 
1.67 


.22 
.33 


1.80 
1.61 


.24 
.29 


.20 
.26 


.19 
.23 


.24 
.26 


.19 
.20 


.15 
.16 


.26 
.25 


.27 
" .14 


.30 

.25, 


5.86 
6.14 


1.35 
1.54 


6.05 
6.38 


' 1.521 
1.72 


5.31 
5.62 


1.44 
1.83 


6.00 
6.00 


1.55 

1.56: 
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Table 7 



Male Students 



Female Students 



Measure 


Test 




- v' Participant 
M SD 


Nonparticipant 
' M SD . 


Minor 


rrc 

Post 


2 54 
2.35 


1 .50 
1.36 


2.42 
2.46 


1.33 
1.42 


Major 


Pre 
Post 


.35 

' .35 


.12 
.10 


.33 
.42 


.09 
.16 


Ale. Costs 


Pre 
Post 


.9/ 

.76 


.50 
.52' 


.60 
.63 

) 


.50 
.56 


Cig Costs 


Pre 

Post ; 


• 00 

.48 


.36 


40 
.59 


.43 
.46 


Pot Costs 


Pre 
Post 


AQ 

.48 


.41 


36 
.55 


.50 
.56 


Ale Involve 


Pre 
Post 


1.42 
1.84 


.73 
.70 


1.51 
1.87 


.62 
.69 


Cig Involve 


Pre 
Post 


.25 
.30 


' ' .09 
.08 


* .28 
.33 


.09 
-.10 


Pot Involve 


Pre 
Post 


.23 
.26 


.06 

- .07 


.25 
.29 


.08 
.10 



Participant Nonparticipaot 
M SD M SD ' 



2.08 
1.82 

.34 
.31 

.31 
.38 

.39 
.41 

..28 
.29 

l.£0 
1.43 

.27 
.31 

.22 
.26 



1.27 
.80 

.11 
.04 

.32 
.43. 

.35 
.46 

.29 
.42 

.44 

.55 

.08 
.10 

.04 
.08 



1.27 
U69 

.30'. 
.32 

.48 
.48 

,46 
.54 

..31 
.35 

1.18 
1.40 

.27 
.3* 

.23 
.27 



.63 , 
1.11 

.02 
.09 

.40 
,42 

.43- 
.46, 

.32 
.40 

.50 
.46 

.07 
.09 
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Majors Ctg, and Pot. Tor attendance, discipline, and drug-related variables, 
a low score is desirable; whereas, for all other variables a high score is 

\ • ' • - 

desirable. , 

Statistical analysis of measures with floor or ceiling effects generally 
suffers from decreased power (due to decreased reliability) and. from bias. 
For example, students who are at the ceiling on a pretest measure where a 
high score-is desirable cannot show improvement on the identical measure at, 
'posttest. This could 5 bias an analysis against finding a positive treatment 

effect. . 

Ceiling effects were found on some of the affective measures. The per- 
centage of students with a maximum score at the pretest ranged from 8% on Comp 
to 42% on Social Self with a median value of 26%. The corresponding percent- 
ages atcthe posttest ranged from 7% to 46% with a median value of 21%. 

On the drug-related measures, evidence was found for floor effects. The 

o 

percentage of students with a minimum score at the pretest ranged from 16% on 
Ale Involve to 69% on Pot Involve with a median value of 35%. The correspond- 
ing percentages at the posttest ranged from 7% to 49% with a median value of 
27%. 

In sum, the affective measures did not suffer from substantial ceiling 
effects. Although floor effects were substantial on several of the drug- 
related measures, they were expected given the ape of the students. Further- 
more, they do not constitute a problem for the preserit study, because no 
direct effects on these measures were hypothesized. 

Initial Equivalence— Students 

Initial equivalence between conditions affects both the justification 
for attributing posttest differences to the treatment (internal validity) 
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and the justification for generalizing treatment effects to other student . 
groups (external validity). As a test for initial equivalence, analysis of 
variance was performed on each of the 14 (8 for grade 4) student pretest 
measures with treatment condition (participant vs. nonparticipant) as the 
factor. Effect sizes, expressed in the metric of the nonparticipant group 
standard deviation,' are presented" for. measures with significant differences. 

For grade" 4-malS no. significant treatment differences were obtained. 
For grade 4 females treatment differences were obtained for Att School, F 
<1.61) « 5.09.V.05, and Affec Climate, F (1,160) = 4.67, p_<^5,_ As com- 
pared to nonparticipants, participants were initially more positive toward 
school (.34 SD) and more positive toward the teaching climate (.31 SD). A 
treatment difference was obtained for grade 5 males on Affec Climate, F (1,137) 
= 9.75, p_ <.01. As compared to nonparticipants, participants were more 
positive toward the teaching climate (.52 SD).. For grade 5 females, treatment 
differences were obtained on Affec Climate, F (1,124) = 4.67, p_ <.05, Read, 'J 
F (1,129) = 3.93, E < .05, and Math F (1,129) = 9.28, p. < .05. As compared 
to nonparticipants, participants were more positive toward the teaching 
climate (.37 SO) and scored lower on .tests of reading. (.37 SD) and mathematics 
(.39 SD) achievement. A treatment difference was obtained for. grade 6 males 
on Att School, F (1,117) = 4.57, p_ <.05. As compared to nonparticipants, 
participants were more positive toward school (.41 SD). Finally, for grade 6 
females, treatment. differences were'obtained on Unex Abs, F 0.128) = 5.46, 
£ <.05, Hath, F (1.18) - 5.71, p_<.05, Minor, F (1,119) = 21 .67, p_ <.001 , 
Major, F (1,120) - 6.92, p_ <.QU and Ale Costs, F (1,121) - 5.91, p_<.05. 
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As compared to nonpartici pants, participants had fewer unexcused absences 
(.40 SD) and lower mathematics achievement scores (.45 SD). Participants 
also presented more minor (1.29 SD) and major (1/.64) discipline problems, and 
attributed fewer negative consequences to alcohol use (.41 SD). 

In sum, with the -xception of grade 4 males, participants initially 
differed from nonpartici pants; the differences occurred on more variables 
for females than for males. 

Analysis of Student Outcomes 

A one-way analysis of covariance wa"s conducted on each posttest measure 
with treatment condition (participant vs. nonpartici pant) as the factor and 
the corresponding pretest as the covariate. Because Coop and Compare not 
measured at pretest, analyses of variance were conducted on the posttest data. 
For grade 4, analyses of variance were also conducted on the following post- 
test measures due to the lack of pretests: Attend, Unex Abs, Minor, Major, 
Read, Math, and the drug-related variables. Treatment effect sizes are pre- 
sented in the metric of the posttest nonpartici pant group standard deviation. 
' Table 8 summarizes the results of the posttest analyses. For grade 4 
males, a significant positive treatment effect was obtained on Att Peers 
(.29 SD). For grade 4 females, negative treatment effects were obtained on 
Minor (.67 SD) and Math (.39 SD\. For grade 5 males, positive treatment 
effects were obtained on Major (.49 SD), Cig (.40 SD), and Pot (.41 SD).. 
For grade 5 females, positive treatment effects were obtained on Control 
Fail (.50 SD) and Cig (.35 SD), and a negative effect, on Math (.28 SD). 
For grade 6 males, positive treatment effect's, were obtained on Coop (.57 SD) 
and Major (.44 SD). For grade 6 females positive^ treatment effects were" . 
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Summary of Analyses of Covariance on Student Data 
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Grade 4 
Males 


Grade 4 
Females 


Grade 5 
Males 


Grade 5 
Females 


Grade 6 

Mai PC 


Grade 6 
Females 


1.60 


3.34 


<1 


J. Id 


10 30** 


4.74* 


<1 


2.97 


<1 


1 .72 


^ 1 


<1 


<1 


*> 

2.55 


<1 


< 1 


1.52 


13.80** 


2.63 


1.65 


1.66 


<i 




<1 


<1 


<1 , 


<1 


<i 


< i 


<1 


4.47* 


<1 


2.15 


1 .13 


<1 


<1 


<1 


2.37 


<1 


<1 


^ i 


1.06 


<1 


<1 


<1 


10.09 


<i 
^ i 


1.02 

e 


<1 


1.09 


<1 


2.02 


< i 


3.63 


<1 


1.99 


<1 


1.52 ^ 


< I 


2.35 


1.28 


3.09 


3.70 


<1 


1 73 


<1 


<1 


<1 


<1 


1 .62 


^ i 


1.44 


1.34 


2.47 


<1 


3.06 


< 1 


<1 


<1 


5.34* 


1.88 


6. 13* 


3 38 


3.99* 


3.37 


9.67** 


<1 


< 1 


<1 


1.85 


<1 


<1 


8.32 


Z .vc 


8 25** 


1.61 


<1 


3.24' 


2.33 


<1 


9 Oft 


<1 


<1- 


1.98 


<1 


<1 


1.31 


2.61 


> 

<1 


<1 


2.72 


<1 


<1 


<1 


1.68 


1.06 


1.51 


<1 


<1 


<-l 


<1 


<1 


6.16* 


4.61* 


<1 


<1 


<1 


<1 


7.66** 


<1 


2.09 


<1 



Measure 
Coop 
Comp 

Affec Climate 
Att School 
Social Self 
Att Peers 
Control Sue 
Control Fail 
Acad Self 
peer Att Sen 
Total Abs 
Unex Abs 

Read 

Math 

Minor 

Major 

Ale Costs 
: Cig Costs 

Pot Costs 

Ale Involve 
L C1g Involve 
{ Pot Involve 

* l^ 'S-lM"^ W levies. 108-120 foV gr.de 6 .I*, and 117- 
feiS^ 6 females. * 



138 for grade 
128 for grade 



obtained on Coop (.39 SD), and Math (.27 SD), and a negative effect on Affec, 
Climate (.87 SD). 

Analysis of Student Outcomes for "Exemp lary" Jigsaw 

The student outcome analysis did not yield a pattern of treatment effects. 
The results could possibly be due to the variation in frequency and quality of^ 
Jigsaw implementation (Cook and Campbell, 1979). A secondary analysis was 
performed in order to determine whether the "exemplary" Jigsaw classes obtained 
a pattern of student outcomes. Three exemplary Jigsaw classes were identified 
using the Jigsaw Checklist data-one 5th, one 6th, and one 5th-6th grade, 
combination. The classes spent an average of 2.4 hours per week engaged in 
Jigsaw. 

A one-way analysis of covariance was conducted on each posttest measure . 
with condition (exemplary Jigsaw participant vs. nonpartlcipant) as the factor 
and the corresponding pretest as the covariate. Analyses of variance were 
conducted on the Coop and Comp posttests. Separate analyses were performed 
for each grade-sex group. The significant results are summarized below. For 
grade 5 males, exemplary Jigsaw participants had better attendance (Attend) 
F (1,109) = 4.24, £ <.05. For grade 5 females, exe apiary participants attri- 
buted failure more internally (Control' Fail), F (1,99) • 5.31, £ <.05, per- 
ceived more positive peer attitudes toward school (Peer -Att School) , . 
F (1,101) « 9.71, £< .01 and perceived their classrooms as less competitive 
(Comp), F (1,103) « 8.34, £ < .01. For grade 6 males, exemplary participants 
perceived their classrooms as more cooperative (Coop), F (1,102) * 7.28, 
£ < .01, perceived more positive peer attitudes" toward school, F (1,99) = 5.22, 
£ <.05, and were reported by their teachers to engage in /ewer major discipline 
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problems (Major), F (1,96) * 7.08, p. <.01. finally, for grade 6 females, 
exemp 1 -y participants perceived more positive peer attitudes toward 
school, £ (1,94) « 6.88, £<.01, and were less invoV *J with cigarettes 
(Cig Involve), F (1,97)^ » 7.08, p_<.01, and marijuana use (Pot Involve), 
F (1,98) « 8.56, £,<.01; however, they also perceived a more negative 
teaching clinate (Affec Climate), F (1,96) = 5.11, £<.05, and had more 
unexcused absences (Unex Abs), F (1,98) « 6.24* £ <.05. 

The results from these analyses also do not form a pattern. The positive 
effect on Peer Att School which was found for three of the four subgroups did 
not replicate in the primary analyses which compared all participants with non- 
participants. Of the 26 significant effects obtained in both sets of analyses 
for grades 5 and 6, there were only four effects common to both: a. positive 
effect on Control Fail for grade 5 females, positive effects on Coop and Major 
for arade 6 male's, and a negative effect on Affec Climate for grade 6 females. 
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Discussion • 



The present study shares some methods; jical weaknesses with previous 
sti/dles of Jigsaw.. Most studies' have used designs In which units were % 
'assigned nonrandomiy to condition. Furthermore, all studies employed student 
level analyses, whereas classrooms .were the units treated. This analysis 
strategy creates Vrlsk of obtaining spurious results because 1t Inflates 
statistical power and falls to control for bias due to student Interdepen- 
dence. The present outcome results should be Interpreted 1n light of these 
Important limitations. : . 

^ The hypothesized effects of Jigsaw were not supported by the data. 
There were no significant differences on the teacher measures of faculty 
coheslveness, teaching satisfaction, or the Importance and effectiveness of 
achieving teaching objectives related to Jigsaw. Although there were several 
effects on students' attitudes and behavior, these generally were not obtained 
across ;grade-sex groups or across primary and secondary analyses. Some Isolated 
effects that replicated In both analyses were the positive effects for 6th drade 
' boys on cooparatlve classroom climate and major discipline problems, the posi- 
tive effect for 5th irade. girls on locus of control for failure and the negative 
effect for 6th grade girls on affective teaching climate. 

Peer teaching programs have been used by educators and prevention practi- 
tioners to^ncrease students' satisfaction with school, teachers and peers*, 
and to ImproW self-esteem. Jigsaw was selected because 1*1$ a peer teaching 
program that Involves all students. Jigsaw 1s different from many peer teaching 
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programs l\ that it provides opportunities for each student to be both teacher 
and pupil in the context of a small, interdependent work group. 

The Jigsaw format dictates specific conditions that may have been in- 
adequately met in the present study.. In Jigsaw classrooms, children must 
depend on ofii another to learn the regular curriculum. Student interdependence 
is required for learning, and dependence on the teacher or on the smartest , 
students is avoided. In the present study,, traine/ anecdotes, based on class- 
room observation, indicated that many teachers seemed reluctant to allow their 
s'tudent groups to work autonomously. The researcher's observations were con- 
sistent with this since teacher interference in student groups was frequent in 
* half of the experimental classropms.. It seems likely that student interdepen- 
dence was undermined by certain intrusive teacher behaviors. 

-The element of "required" interdependence among students is what makes 
Jigsaw a distinctive peer teaching program, and yet, it was probably the^most 
poorly implemented aspect of the program. Students are' interdependent to the - 
extent that each child has a unique and critical piece of information to v 
contribute to group learning of an assigned task. In. about 60% of the parti- 
cipating classrooms, studenisvhad limited or no opportunity to contribute to 
group learning. In a few classrooms, students spent ah excessive amount of 
- ttme in their expert groups which delayed teaching in Jigsaw groups until 
'after -thVposttest.V.Jigsaw^ was modified by the teachers and student teaching 
was el imi flatted in several- other classrooms. Where student teaching was . 
eliminated, students completed worksheets and simply read or held up the 
answers'for other students in their groups to copy. In- these classrooms, • 
students were working individually or. in pairs as opposed to working coopera- 
tively on a topic. - , „ - 1 
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Apparently, students were not well prepared to work wittrene another pro- 
ductively. The observational' data suggest that in half the classrooms there 
was a striking lack of constructive group behavior. According to Aronson, 
et al. (1978), it is essential that students learn cooperative, constructive 
group process skills before they actually work with academic material: They 
recommend that teachers involve students in team-building exercises for a 
short period each day t>ver one or two weeks so that students will learn mutual 
respect and interpersonal skills. Both the observational data and the teacher 
logs provided evidence that team-building activities were conducted much less 
intensively tflan recommended. 

The literature on Jigsaw provides only a vague notion regarding minimal 
effective levels of Jigsaw implementation. Beneficial effects of Jigsaw have 
been reported with two to four hours of Jigsaw per week. The lack of con- 
sistent positive effects in the present study does not seem attributable to 
inadequate frequency of implementation. Considering only the exemplary 
teachers' classrooms, we found that about 2.4 hours per week, or USTof student 
time in the classroom was devoted to Jigsaw. This finding compares favorably, 
in terms of number of hours per week, with implementation levels reported by 

Blaney, et al. (1977). 

It must be pointed out that there were a number of differences between 
the present study and previous research & on Jigsaw. For example, previous 
studies were short-term; teachers were asked to implement Jigsaw in their 
classrooms for only two to eight weeks. In the Resent study,' teachers were 
asked to implement Jigsaw for approximately sfkmonths. On the positive side, 
the longer duration of this study should have produced more beneficial effects 
than found by Blariey, et al. since students were exposed to rwre total hours 
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of Jigsaw, particularly in our exemplary classrooms. Curiously, even in 
these three classrooms, we did not find the predicted positive effects. For 
the other participating teachers, the length of involvement in this study may 
have seemed costly in terms of time and effort, which may have impacted the 
quality or frequency of Jigsaw implementation. 

This study may simulate more closely than previous studies the impact 
of Jigsaw under naturalistic conditions. Although careful monitoring of 
program implementation is atypical, teacher in-service training is often 
selectedV imposed by school district officials and conducted by outsiders. 
Where teachers do not themselves initiate a request for: Jigsaw training, 
their reception of Jigsaw may not meet the expectations of those providing 
the training. Many teachers may opt not to participate in the training (in 
this study, about one-half of the eligible teachers), or they may participate 
without much commitment. Of those teachers who complete the training, many 
may modify Jigsaw by eliminating critical components (e.g., peer teaching .or 
task interdependence) thereby undermining it's effectiveness. Few teachers 
may actually implement Jigsaw appropriately and effectively in their class- 
rooms (in this study, about one-fourth of those who completed the training). 

This speculation may be unduly pessimistic, especially since our re- 
cruitment,, training, and classroom follow-up procedures all could bo improved. 
Nevertheless, many teachers may be reluctant to make the necessary change in 
role from instructor to facilitator regardless of the nature or amount of 
in-service training. Future research should be conducted to determine how 
to overcome teacher resistance and improve classroom implementation. To the 
extent possible, further studies of Jigsaw should employ experimental designs 
with.classes as the unit of analysis, and include extensive process 'evaluation. 
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